Registration of histology and magnetic resonance imaging of the brain

Combining histology and non-invasive imaging has been attracting the attention of the medical imaging community for a long time, due to its potential to correlate macroscopic information with the underlying microscopic properties of tissues. Histology is an invasive procedure that disrupts the spatial arrangement of the tissue components but enables visualisation and characterisation at a cellular level. In contrast, macroscopic imaging allows non-invasive acquisition of volumetric information but does not provide any microscopic details. Through the establishment of spatial correspondences obtained via image registration, it is possible to compare micro- and macroscopic information and to recover the original histological arrangement in three dimensions. In this thesis, I present: (i) a survey of the literature relative to methods for histology reconstruction with and without the help of 3D medical imaging; (ii) a graph-theoretic method for histology volume reconstruction from sets of 2D sections, without external information; (iii) a method for multimodal 2D linear registration between histology and MRI based on partial matching of shape-informative boundaries

Part-to-whole Registration of Histology and MRI using Shape Elements

Image registration between histology and magnetic resonance imaging (MRI) is a challenging task due to differences in structural content and contrast. Too thick and wide specimens cannot be processed all at once and must be cut into smaller pieces. This dramatically increases the complexity of the problem, since each piece should be individually and manually pre-aligned. To the best of our knowledge, no automatic method can reliably locate such piece of tissue within its respective whole in the MRI slice, and align it without any prior information. We propose here a novel automatic approach to the joint problem of multimodal registration between histology and MRI, when only a fraction of tissue is available from histology. The approach relies on the representation of images using their level lines so as to reach contrast invariance. Shape elements obtained via the extraction of bitangents are encoded in a projective-invariant manner, which permits the identification of common pieces of curves between two images. We evaluated the approach on human brain histology and compared resulting alignments against manually annotated ground truths. Considering the complexity of the brain folding patterns, preliminary results are promising and suggest the use of characteristic and meaningful shape elements for improved robustness and efficiency.Comment: Paper accepted at ICCV Workshop (Bio-Image Computing

A Survey of Methods for 3D Histology Reconstruction

Histology permits the observation of otherwise invisible structures of the internal topography of a specimen. Although it enables the investigation of tissues at a cellular level, it is invasive and breaks topology due to cutting. Three-dimensional (3D) reconstruction was thus introduced to overcome the limitations of single-section studies in a dimensional scope. 3D reconstruction finds its roots in embryology, where it enabled the visualisation of spatial relationships of developing systems and organs, and extended to biomedicine, where the observation of individual, stained sections provided only partial understanding of normal and abnormal tissues. However, despite bringing visual awareness, recovering realistic reconstructions is elusive without prior knowledge about the tissue shape. 3D medical imaging made such structural ground truths available. In addition, combining non-invasive imaging with histology unveiled invaluable opportunities to relate macroscopic information to the underlying microscopic properties of tissues through the establishment of spatial correspondences; image registration is one technique that permits the automation of such a process and we describe reconstruction methods that rely on it. It is thereby possible to recover the original topology of histology and lost relationships, gain insight into what affects the signals used to construct medical images (and characterise them), or build high resolution anatomical atlases. This paper reviews almost three decades of methods for 3D histology reconstruction from serial sections, used in the study of many different types of tissue. We first summarise the process that produces digitised sections from a tissue specimen in order to understand the peculiarity of the data, the associated artefacts and some possible ways to minimise them. We then describe methods for 3D histology reconstruction with and without the help of 3D medical imaging, along with methods of validation and some applications. We finally attempt to identify the trends and challenges that the field is facing, many of which are derived from the cross-disciplinary nature of the problem as it involves the collaboration between physicists, histolopathologists, computer scientists and physicians

Pathologic correlates of the magnetization transfer ratio in multiple sclerosis

OBJECTIVE: To identify pathologic correlates of magnetization transfer ratio (MTR) in multiple sclerosis (MS) in an MRI-pathology study. METHODS: We acquired MTR maps at 3T from 16 fixed MS brains and 4 controls, and immunostained 100 tissue blocks for neuronal neurofilaments, myelin (SMI94), tissue macrophages (CD68), microglia (IBA1), B-lymphocytes, T-lymphocytes, cytotoxic T-lymphocytes, astrocytes (glial fibrillary acidic protein), and mitochondrial damage (COX4, VDAC). We defined regions of interest in lesions, normal-appearing white matter (NAWM), and cortical normal-appearing gray matter (NAGM). Associations between MTR and immunostaining intensities were explored using linear mixed-effects models (with cassettes nested within patients) and interaction terms (for differences between regions of interest and between cases and controls); a multivariate linear mixed-effects model identified the best pathologic correlates of MTR. RESULTS: MTR was the lowest in white matter (WM) lesions (23.4 ± 9.4%) and the highest in NAWM (38.1 ± 8.7%). In MS brains, lower MTR was associated with lower immunostaining intensity for myelin (coefficient 0.31; 95% confidence interval [CI] 0.07-0.55), macrophages (coefficient 0.03; 95% CI 0.01-0.07), and astrocytes (coefficient 0.51; 95% CI 0.02-1.00), and with greater mitochondrial damage (coefficient 0.31; 95% CI 0.07-0.55). Based on interaction terms, MTR was more strongly associated with myelin in WM (coefficient 1.58; 95% CI 1.09-2.08) and gray matter (GM) lesions (coefficient 0.66; 95% CI 0.13-1.20), and with macrophages (coefficient 1.40; 95% CI 0.56-2.25), astrocytes (coefficient 2.66; 95% CI 1.31-4.01), and mitochondrial damage (coefficient -12.59; 95% CI -23.16 to -2.02) in MS brains than controls. In the multivariate model, myelin immunostaining intensity was the best correlate of MTR (coefficient 0.31; 95% CI 0.09-0.52; p = 0.004). CONCLUSIONS: Myelin was the strongest correlate of MTR, especially in WM and cortical GM lesions, but additional correlates should be kept in mind when designing and interpreting MTR observational and experimental studies in MS